Search AI Products and News

According to reports, the U.S. Department of Commerce has added Zhipu AI to its entity list for export controls, accusing it of promoting China's military modernization and infringing on U.S. national security and diplomatic interests. ** This decision makes Zhipu AI the first Chinese large model company to be added to the U.S. entity list, marking a new round of suppression by the U.S. on China's artificial intelligence industry. Zhipu AI subsequently issued a statement emphasizing that the company is based on technology transfer from Tsinghua University and provided a detailed review of its technological development history. Zhipu AI started developing the GLM pre-training architecture in 2020 and launched it in 2022.

Beijing Academy of Artificial Intelligence (BAAI) has recently launched the world’s first Chinese large model debate platform, FlagEval Debate. This new platform aims to provide a novel measurement approach for evaluating the capabilities of large language models through a competitive mechanism of model debates. It is an extension of the FlagEval arena for large model combat evaluation services, designed to identify capability differences among large language models.

["Zhipu AI has released an evaluation benchmark AlignBench for Chinese large models", "AlignBench can evaluate the alignment level of models and human intentions in multiple dimensions", "The dataset is divided into 8 major categories, including knowledge Q&A, writing generation, role-playing, and various types of questions", "Developers can use AlignBench for evaluation and score using a robust scoring model", "By logging into the AlignBench website, users can submit their evaluations."]

SuperCLUE has released the August rankings for Chinese large models, featuring 5 different ranking evaluations that selected 16 general large language models, utilizing 3,337 new test questions. The performance gap between domestic large models on Chinese tasks and GPT-3.5 is narrowing.